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Abstract. The paper focuses on the structure of fundamental sequences of ordinals smaller 
than eo. A first result is the construction of a monadic second-order formula identifying a 
given structure, whereas such a formula cannot exist for ordinals themselves. The structures 
are precisely classified in the pushdown hierarchy. Ordinals are also located in the hierarchy, 
and a direct presentation is given. 
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A recurrent question in computational model theory is the problem of model checking, i.e. 
the way to decide whether a given formula holds in a structure or not. When studying infinite 
I 1 , structures, first-order logic only brings local properties whereas second-order logic is most of the 

^ ' time undecidablc, so monadic second-order logic or one of its variants is often a balanced option. In 

, the field of countable ordinals, results of Biichi [3] and Shelah [T5J both brought decidability of the 

monadic theory via different ways. This positive outcome is tainted with the following property : 
the monadic theory of a countable ordinal only depends on a small portion of it, called the w-tail 
^ • [31 Th. 4.9]. In other words, many ordinals greater than u> u share the same monadic theories and 

CN \ cannot be distinguished. 

Another class of structures enjoying a decidable monadic second-order theory is the pushdown 
■^-j- . hierarchy [5] , which takes its source in the Muller and Schupp characterization of transition graphs 

of pushdown automata In the same way, each level of the hierarchy has two characteriza- 
tions : an internal by higher-order pushdown automata |4| , and an external presentation by graph 
^\ | transformations [5]. This paper will use the latter by the means of monadic interpretation and 

i treegraph operations. 

The original motivation of this paper was the localization of ordinals smaller than eo in the 
hierarchy. Because of the above property, ordinals themselves are not easy to manipulate with 
monadic interpretations. There is therefore a need of structures as expressive as ordinals (in terms 
of interpretations) but having additional properties, such as the existence of a monadic formula 
precisely identifying the structure. 

A well-known object answers to this request. Each countable limit ordinal may be defined as 
the limit of a so-called fundamental sequence. For ordinals smaller than £o: it is easy to have a 
unique definition for this sequence using the Cantor normal form. We note a ~< (3 when a is in the 
fundamental sequence of /3 or a + 1 = (3. When restricted to ordinals smaller than A, we call the 
resulting structure the covering graph of A. In Section O we present precisely this structure and 
give some of its properties. In particular, the out-degree of its vertices is studied intensively. This 
eventually yields a specific formula for each covering graph. 

Section [3] locates the covering graph of any ordinal a smaller than £o m the level n of the 
hierarchy, where n is the largest size of the w-tower smaller than a. The result also applies to 
ordinals themselves. This was already shown for ordinals up to uf° in [Tj. In Section [H the result 
in strengthened by proving that covering graphs are not in the lower levels; the question is still 
open for ordinals. Eventually, we produce a direct presentation for towers of u> through prefix- 
recognizable relations of order n, but involving a more technical proof. 

Similar attempts of characterization of ordinals has been made in the field of automaticity 
8 10] , but in the other way around : word- and tree- automatic ordinals are shown to be respectively 
less than and lo^ . 



1 Definitions 



In this paper, ordinals arc often considered from a graph theory point of view. The set of vertices 
of a is the set of ordinals smaller than a, and the set of arcs is the relation <. 



1.1 Graphs 

Graphs are finite or infinite sets of labeled arcs. A I7-graph is a set G C V x E x V, where V 
(or Vq if unclear) is the support, i.e. a finite or countably infinite set of vertices, and E a finite 
set of labels. An element (p,a,q) of G is called an arc and noted p — —* q. Each label a G E is 
associated to a relation R a = {(p,q) | p q) on V. A finite sequence of arcs p — . . . — ^ g is a 

pai/i and noted p Ql "' Q " > q. This is extended to languages with p —> q iff 3u G i such that p —> q. 
Isomorphism between graphs is noted ~. 

The monadic second-order (MSO) logic is defined as usual; see for instance [9]. We take a set 
of (lowercase) first-order variables and a set of (uppercase) second-order variables. For a given set 
of labels E, atomic formulas are x G X, x = y and x — y for all a 6 E and x,y,X variables. 
Formulas are then closed by the propositional connectives ->, A and the quantifier 3. Graphs are 
seen as relational structures over the signature consisting of the relations {R a } a eS- The set of 
closed monadic formulas satisfied by a graph G is noted MTh(G). 

Given a binary relation R, the in-degree (respectively out-degree) of x is the cardinality 
of {y\yRx} (resp. {y\xRy}). The output degree in a graph G of x G V is the cardinal of 
{y | 3a, (x, a, y) G G}. The output degree of a graph is the maximal output degree of its vertices if 
it exists. 



1.2 Ordinals 

For a general introduction to ordinal theory, see [14113] . An order is a well-order when each non- 
empty subset has a smallest element. Ordinals are well-ordered by the relation G, and satisfy 
\/x(x G a => x C a). Since any well-ordered set is isomorphic to a unique ordinal, we will often 
consider an ordinal up to isomorphism. In terms of graphs, the set of labels of an ordinal is a 
singleton often noted E = {<} and the graph respects the following monadic properties : 



(strict order) 



1 VP,g(-i(p — >q/\q — > p)) 

\ VP, q, r((p -^?A(?^r)^p^r) 
(total order) Vp, q(p q V q p V p = q) 

(well order) VA ^ 3x(x G X A \/y{y £l^(i^!/Vx = y))) 

The ordinal arithmetics define operations on ordinals such as addition, multiplication, expo- 
nentiation. The bound of ordinals investigated here is £o, the smallest ordinal such that £o = lo e °; 
therefore the declaration "< £o" is implicit through the rest of the paper. To simplify 
the writing of towers of cu, the notation fr is used to note the iteration of exponentiation ie. 

a fr b — a a | b times. In particular, a ff = 1 is the (right) exponentiation identity. 

Classic operations are not commutative in ordinal theory : for instance oj + uj 2 = to 2 < lu 2 + to. 
This leads to many writings for a single ordinal. Fortunately, all ordinals smaller than eo may 
uniquely be written in the Cantor normal form (CNF) 



where < • ■ • < ao < a. An alternative we will call reduced Cantor normal form (RCNF) is 
a = uj a °.co + • • • + uj ak .Ck where < ■ ■ ■ < «o < ot and c\,...,cu are non-zero integers. To 
express ordinals smaller than £o from natural numbers and uj, the only operations needed are thus 
addition and exponentiation. 



2 Covering graphs 



In this section, we define the covering graph of an ordinal as the graph of successor and fundamental 
sequence relations. Then, we prove some of its important properties. One of them is the finite degree 
property, which is worked out to bring a specific monadic formula for each covering graph, thus 
allowing to differentiate them. 

2.1 Fundamental sequence 

The cofinality [14| of any countable ordinal is uj. To each limit ordinal a we may associate a uj- 
sequence whose bound is a. For a < eo, a = (3 + uj 1 with (3 < a, 7 < a and uj 1 is the last term in 
the CNF of a, we define the fundamental sequence (a[n]) n<u) as follows : 



We define a! -< a whenever there is k such that a 1 = a[k], or if a' + 1 = a. 

For instance, the fundamental sequence of uj is the sequence of integers starting from 1. The 
sequence of uj u is therefore (uj, uj 2 , uj 3 , . . .). The fundamental sequence merged with the successor 
relation yields for instance 



Taking the transitive closure of this relation gives back the original order, so there no information 
loss. 

Lemma 1 The transitive closure of -< is < . 

Moreover, the relation is crossing-free as described below, which is a helpful technical tool. 
Lemma 2 If a± < \± < a.i, ol\ < a>2 and Ai -< A2, then A2 < ct%. 

This is the forbidden case : 



2.2 Covering graphs 

Let Q a = {Ai -< A2 I Ai, A2 < a} be the graph of successor and fundamental sequence relation, or 
covering graph of the ordinal a. For instance, a representation of is given in Figure 1. 
We first remark the finite out-degree of the covering graphs. 

Lemma 3 For any u> § (n — 1) < a < lu i[ n and n > 0, the out-degree of Q a is n. 

In the following, we refine this property to get a characterisation of an ordinal by the degree of 
its vertices. We define the degree word u{pt) of a covering graph as follows. Consider the greatest 
sequence a of Q a starting from 0, i.e. do = and for k > 0, er/c+i is the greatest such that 
o~k ~< ffc+i- The previous lemma ensures that {A | o~k -< A} is finite, so o~k+i exists. Such a sequence 
may be finite. 

The degree word u(a) is a finite or infinite word over [0, n] when a < u> ij n, and its fc th letter 
is the out-degree of in Q a . 

For instance, consider Its greatest sequence is (0, 1, u>, uj 2 , lu 3 , . . . ), where all have degree 

2 in except the first; so = 12". Now consider u(u> 3 + lo 2 ) : the sequence is now 





1 



■2 



0, 1, CJ, UJ 2 , UJ 3 , UJ 3 + 1, UJ 3 + LU 7 LU 3 + UJ + 1, . . . 



which loops into (. . . , uj 3 + uj.k, u 3 + uj.k + 1, . . . ) so u(uj 3 + uj 2 ) = 12221(21) 



Fig. 1. covering graph of u' 



Lemma 4 For any a < u> ft n, if a is successor then u(a) is a finite word of [0,n]*; otherwise 
u(a) is an ultimately periodic word of [l,n]". 

Proof (sketch). If a is successor, then since the greatest sequence is unbounded, the prede- 
cessor of a is in it and the word is finite. Otherwise, we prove that a[k] is in the greatest sequence 
of a for all finite k. The sequence of degrees from to a[0] forms the static part of the ultimately 
periodic word, whereas the sequences of degrees between a[k] and a[fc + 1] arc always the same. □ 
Let <" ex be the lexicographic ordering on words on [0,n] based on standard order. Degree 
words differ for each ordinal. 

Lemma 5 If a < a 1 <ui ftn, then u(a) <Y ex u(a'). 

Proof. Consider n > 0, otherwise its degree word of a is the empty word. As before, note that the 
greatest sequence is unbounded, and that aa = a' = 0. Thus if < a < a' and a' is the greatest 
sequence of Q a >, there is a smallest n > such that <r„ ^ a' n , or a n doesn't exist whereas a' n does. 
In both cases, the output degree of <7„_i is less in Q a than in Q a i, so u(a) <f ex u(a'). □ 

A ultimately periodic pattern can be captured by a monadic formula. This is the goal of the 
the following lemma. 

Lemma 6 For each finite or infinite word u over [0,77,] and a given ordinal a, there is a monadic 
formula tp u such that Q a \= ip u iffu= u(a). 

Proof. The fact that the degree word is finite or ultimately periodic permits to use a finite number 
of variables. We consider the ultimately periodic case, and u(a) = uv u . 
To simplify the writing, we consider the following shortcuts : 

— t(jo, q) stands if q is the greatest such that p -< q; 

— if the output degree of p is k, then dk(p) is true; 

— root(X,p) and end(A,p) are true when p is co-accessible (resp. accessible) from each vertex 
of X, with the entire path in X; root(p) looks for a root of the whole graph; 

— inline (X) checks that A" is a finite or infinite path; 

— sizefe(A) stands for \X\ = k. 

All these notations stand for monadic formulas. For instance, the inlinc(A) property is true when 
there is a root in X and each vertex has output degree 1, and each except the root has input 
degree 1. 



Now we may write the formula tp u . For this, we need two finite sets p\ . . .p\ u \ £ U for the static 
part, qi . . . q\ v i e V for the beginning of the periodic part and an infinite set V with V C V. We 
check that p\ is the general root 0, and q± the root of V, which is an infinite path. Formulas r and 
dk force the degree of the uv part. For the periodic part, each q £ V there must be the root of a 
finite path X q C V of size \v\ + 1, which end has the same degree that q. □ 

The combination of Lemmas [5] and [6] yields the following theorem. 

Theorem 7 For a ^ a' smaller than e , we have MTh(Q a ) ^ MTh(Q a i). 

As a consequence, there is no generic monadic interpretation (see next section for definition) 
from an ordinal greater than to its covering graph. Below this limit, there is an interpretation, 
because it is possible to distinguish successive limit ordinals. 

3 The pushdown hierarchy 

In this section, the pushdown hierarchy will only be defined by monadic interpretations and the 
treegraph operation. For other definitions, see for instance [4]. In particular, each level can be 
defined as the set of transition graphs (up to some closure operation) of finite-state higher-order 
pushdown automata of level n (n-hopda), hence the name. 

A major property shared by this class of graphs is the decidability of their monadic theories. 
Since it is also the case for countable ordinals |1513| , it is natural to examine the intersection. 
Here, covering graphs and ordinals arc located at each level of the hierarchy. 

3.1 Definitions 

A monadic interpretation I is a finite set {ip a {x, y)} a£ r of monadic formulas with two free first 
order variables. The interpretation of a graph GCl/xZ'xT/by/isa graph 1(G) = {p — > 
q | p, q G V A G N (f a (p, q)} f= V x r x V. It is helpful to have r = £ to allow iteration process. 
The set of monadic interpretations X is closed by composition. 

A particular case of monadic interpretation is inverse rational mapping. The alphabet S is used 
to read the arcs backwards : p — — > q iff q — — > p. An inverse rational mapping is an interpretation 

such that </? (p, q) '■= P q where L a is a regular language over S U S. 

For instance, the transitive closure of R a for a label a is a monadic interpretation. By Lemma 
[TJ there is therefore an immediate monadic interpretation from Q a to a. An important corollary 
of Lemma [7] is that the reverse cannot exist, or there would be a monadic formula identifying a 
specific ordinal smaller than which is contradictory to the result of Buchi [3l Th. 4.9] cited in 
introduction. 

For a more complex illustration of a monadic interpretation, we notice that the degree word 
allows the restriction from a greater ordinal. 

Lemma 8 If a < a' , there is a MSO interpretation I such that Q a = I(Q a ')- 

Proof. Following the definition, we look for an interpretation / = {ip^}- We use again the fact 
that the degree word is unique and MSO-dcfinablc. Defining the greatest sequence of Q a provides a 
MSO marking on Q' a , which bounds the set of vertices. More precisely, let fy u (p) be an expression 
similar to ip u of the Lemma [6] but where the part r(pi,pi + i) A 5 Ui (pi) has been replaced by 
T Ui (pi,Pi + i) meaning "ft+i is the uf 1 such that Pi -< Pi+i"; the same goes for the qj and for 
T (p\u\ j Ql)/\fiui u i (p\u\)- Also add the condition that p is a part of the sequence : (Vi_P — Pi)^P £ V. 
Then ty u (p) is a marking of the greatest sequence associated to u. For a given a, I simply adds 
the condition of co-accessibility to a vertex marked by ty u< - a > . 

1>< (p, q) := p q A 3r (& u ^ (r) A q r) 



□ 



The treegraph Treegraph(G) of a graph G is the set {p q} C Vq X (Zg U {#}) x Vq where 
(P) ?) G ^g are sequences of vertices of G, and a 6 Sq either if p = wu, q = wv and u — — > v £ G, 
or if a = p = and 9 = u>«it. One can also see the treegraph as the fixpoint of the operation 
which, to each vertex which is not starting point of an # arc, adds this arc leading to the location 
of this vertex in a copy of G. The starting graph is called the root graph. 

One way to define the pushdown hierarchy (see [5] for details) is as follows. 

— Hq is the class of graphs with finite support, 

— 7i n = T o Treegraph(H. n -i). 

For instance, 7ii is the class of prefix-recognizable graphs [7] and further TL n classes have been 
proved to correspond to an extension of prefix- rccognizability on higher-order stacks [1] . 

3.2 Building covering graphs 

We note p —> q for the longest possible path labeled by a, and p -—> q a shortcut for the successor 
relation, i.e. 

a* a* A -, / a x 

p — ► q ■= P — ► q A ~^dr (q — ► r) 

p — > q := p q A -3r{p r A r q). 



Now let I = {<p~>} and M(p) respectively be the interpretation and marking 

(f^ (p, q) := M{p) A M (q) A p > q V p — S ^> qV p q 
M (pj := dr : Vq (r > q) A r > p 

The marking M(p) allows to start anywhere on the root graph, but as soon as a #-arc has 
been followed, -<-arcs can only be followed backwards. We consider only goals of a #-arc. 

The <y9^ (p, q) formula states the relation on these vertices, leaving three choices : either to 
follow -<-arcs as long as possible (in practice, until a copy of 0) and go down one ^-arc; or on the 
contrary, to follow # backwards as long as possible, then take the successor and one #-arc; or just 
to follow one # backwards, one -< and one #. 

Lemma 9 Q^a = I o Treegraph(C/ Q ). 

For instance consider Q u , which is an infinite path. A representation of its treegraph is given 
below (plain lines for -<, dotted lines for The circled vertices are the ones marked by M and 
therefore they are the only ones kept by the interpretation (p. We are allowed to go anywhere 
on the root Q w structure, but as soon as we follow # we can only go backwards. This reflects 
the construction of a power of uj as a decreasing sequence of ordinals : wc may start by any, but 
afterwards we only may decrease. 

© 
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Lemma 10 If a < lo ff (n+ 1), then Q a £ Tin- 
Proof. For any finite a, Q a is in fact a finite path labeled by -< and is in Ti. . By Lemma |H] iterated 

n times, every w m with n times lo and 1 < k < lo is in H n - Smaller ordinals are captured by a 
restriction as in Lemma [51 □ 

This proves the decidability of the monadic theory of the covering graphs. By transitive closure 
(Lemma [T]), ordinals arc also captured. 

Theorem 11 If a < lo i[ (n + 1), then a € H n . 

The decidability of the monadic theory of these ordinals is well-known, but this result also 
shows that ordinals below eq can be expressed by finite objects, namely higher-order pushdown 
automata. Following the steps of a well-chosen automaton (up to an operation called the e-closure) 
builds exactly an ordinal. This approach is explained in Section [5J 



4 Strictness of the hierarchy for covering graphs 

In this section, we strengthen Lemma [TU] by proving that covering graphs cannot be in any level 
of the hierarchy. Let exp(x, n, k) be a tower of exponentiation of x of height n with power k on 
the top, where n and k are integers. 

exp(x, n, k) = k if n = 

= x eKp ( x ' n ~ 1,k > otherwise. 

In the following section, this function will be used in the cases x = 2 and x = lo. 
We examine the tree T n of trace (from the root) {a"6 cxp ' 2,Tl ' fc - 1 }. It has the form below with 
f(k) = exp(2, n, k). The horizontal arcs are labeled by a and the vertical arcs by b. 

k 



f(k) 



For any n, there is such a tree which is not in the level n of the hierarchy [2]. 
Proposition 1 For n > 1, %, n £ TL n . 

Finding a monadic interpretation from Q a to T^, n is therefore enough to prove Q a (£_ H. n . In 
fact, Lemma |8j already states that if lo \Zn + 1 < a, then there is an interpretation from Q a to 
Qu^3n+V, so the interpretation from <5wt3«+i to T?, n is enough for a whole class of ordinals. We 
sketch this interpretation. 

Let be the set of ordinals smaller than exp(w, n, k) where each coefficient in RCNF is at 
most 1, except for the top- most power : 

- [0,fc-i] eCl 
G Ct 

— if 7o, ... ,7ft are all distinct ordinals of C^_ 1 , then a; 70 + ■ ■ • + Lo lh G C*. 
For instance, Cf = {0, l,w,w+ 1, lo 2 , lo 2 + 1, uo 2 + w, lo 2 + lo + 1}; 

Cf = {0,l,w,w + l,u u ,w u + l,u> u +w,w u +w + l, 

W W+1 ,W W+1 + 1, L0" + 1 - + LO, LO^ +1 +LO+1, 

LO^ +1 + U", LO^ +1 + U>" + 1, LO U + 1 +LO U +LO, LO^ + 1 + LO U + LO + 1} . 



The following lemma is only a matter of cardinality of powcrscts. 



Lemma 12 The cardinality of the set C% is exp(2, n, &). 

We abusively note a + for the set {a + 7 | 7 £ C„}. The main difficulty of this section is 
to define a monadic formula for this set. 

Lemma 13 For n > 0, there is a monadic formula describing cxp(u>,n, k) + C„ in Q a , for a 
greater than exp(aj, n,k).2. 

These ordinals are easy to capture by previous tools. The following lemma is a natural corollary 
of the proof of Lemma[5J since exp(w, n, k) ~< cxp(u>, n, k + 1). 

Lemma 14 The greatest sequence of uj fr(n + 1) is ultimately the sequence (exp(w, n, A;))fe>i . 

We may now state the main result of this section. 
Theorem 15 // n > and a > to ff3n + 1, then Q a £ H n . 
Proof (sketch). If we concatenate the previous lemmas, it appears that 

— since the greatest sequence of a is interprctablc from Q a , we can extract the sequence (exp(w, 3n, fc))&>i 
from CL>-ft-3n+i, which will be the "horizontal path" of Ts n ; 

— for each exp(w, 3n, k) we can also capture the associated set exp(o>, 3n, k) + C|„ and arrange it 
in path. This yields the "vertical path" hanging from cxpfw, 3n, k) and of length exp(2, in, k). 

Eventually, the monadic interpretation builds exactly 73„, which is the expected result. □ 
The covering graph Q eo can be defined and has unbounded degree, but has still the property of 
Lemma |8] : it can give any smaller ordinal via monadic interpretation, which yields the following 
result. 

Corollary 16 Q £o does not belong to the hierarchy. 

From [5] we could actually extract the lower bound 72„ ^ H. n - The conjecture is that T n £ H n , 
which would allow to locate exactly each covering graph in the hierarchy 

The Theorem [15] does not apply to ordinal themselves, since there we showed that there is no 
interpretation from ordinals to covering graphs. Therefore, the question is still open, which leads 
to Conjecture [T] at the end of this paper. 

5 Higher-order stack description of ordinals 

The graph on the level n of the hierarchy are also graphs (up to e-closure) of higher-order pushdown 
automata of level n [5], i.e. automata which use nested stacks of stacks of depth n. The construc- 
tion by monadic interpretations and unfolding could be translated into a pushdown automata 
description. Instead of doing so, we use the equivalent notion of prefix-recognizable relations [1] 
from scratch. This notion offers a natural encoding of ordinals by their Cantor normal form. 
Nonetheless, the associated proof is still heavy. 

5.1 Short presentation 

This section sketches a particular case of prefix-recognizable graphs. For a complete description, 
see [4]. We only consider 1-stacks (usual stacks) over an alphabet of size 1, i.e. integers. The empty 
1-stack is therefore noted 0. For all n > 1, a n-stack is a non-empty finite sequence of (n — l)-stacks, 
noted [ai, . . . ,a m ]„. The operations Ops\ on a 1-stack arc 



push 1 (i) := i + 1, 
P0Pi(« + 1) := i- 



For n > 1, the set Ops n of operations on a n-stack include 



copy n ([ai, . . .,a m } n ) 

POP„([ai, . . .,fltm]n) 

/([ai,...,a m ]„) 



— [fll ; . . . , flm, flm]n 
= [Ol, . . • , a m -l] n 
= [Ol, • • ■ , /(o ro )]„ 



where / is any operation on &;-stacks, k < n. 

The 2-stack containing only is noted [ ]2, and the n-stack containing only [ ] n _i is noted [ ]„. 
Let also be an identity operation id defined on all stacks. 

The set Ops n forms a monoid with the composition operation. Let Reg(Ops n ) the closure of the 
finite subsets of this monoid under union, product and iteration, i.e. the set of regular expressions 
on Ops n . To each expression E G Reg{Ops n ) we associate the set of n-stacks S(E) = E{{ ] n ) and 
the set of relations on stacks R{E) = {(s,s')\s' £ E{s)}. 

Given E and a finite set {E a ) a ^s in Reg(Ops n ), the graph of support S(F) and arcs s — —> s' 
iff (s,s') S R(F a ) is a prefix-recognizable graph of order n. General prefix-recognizable graphs are 
exactly graphs of pushdown automata of the same order. 



5.2 Towers of oj 

We define the expressions dom and inc which respectively fix the domain of the structure and the 
order relation. In the following we also will need an expression dec to perform the symmetric of 
inc. In one word, we want the structure (5(dom(a)), i?(dec(a)), i?(inc(a))) to be isomorphic to the 
structure (a, >, <}. 

For cu, we consider the set of all 1-stacks (i.e. integers). In this case, dom(u;) is obtained by 
iterating push] on the empty stack. The other operations are also straighforward. 

dom(cj) := push] 
inc(w) := push^ 
dec(w) := pop^ 

We consider now any ordinal a. Let n be the smallest value such that dom(a), inc(a) and 
dec(a) are all in Reg(Ops n -\). 

Let tail(a) := copy n .(id + dec(a)). Informally, each ordinal 7 < oj a is either or may be written 
as 7 = u) la + ■ ■ -+uj lk with 7j < a; so we code 7 as a sequence of stacks respectively coding 70 • ■ . Tfe. 
The tail operation takes the last stack (representing 7^) and adds a stack coding an ordinal < 7^, 
so that the CNF constraint is respected. For the relation <, inc either adds a decreasing sequence 
(by tail), or it first pops stacks, then increases a given one before adding a tail. 

dom{u a ) := dom(a).tail(a)* 
inc(w Q ) := [pop*.inc(a) + tail(a)].tail(a)* 
dec(w a ) := po P ;.[pop„ + dec(a).tail(a)*] 

We get this version of Theorem QT] restricted to towers of u>. 

Theorem 17 The graph of lo fT n is isomorphic to the prefix-recognizable graph of order n with 
support S(dom(cu n)) and one relation R(inc(uj f]~ n)). 

The proof of this proposition encodes exponentiation of u), so the case of all ordinals smaller 
than £0 can be obtained by encoding also addition. This can be done with a greater starting 
alphabet and using markers to differentiate each part of the addition. 



6 Perspectives 

We have defined covering graphs as graphs of fundamental sequence and successor relations and 
shown the existence of a formula identifying a covering graph among others, via the degree word. 



Then, the covering graphs and the corresponding ordinals have been located in the pushdown 
hierarchy according to the size in terms of tower of u>, in a strict way for the covering graph case. 

TheoremQT] raises the question of the strictness of the classification of ordinals in the hierarchy. 
Theorem [TBI naturally suggests that if a > u ff n, then a does not belong to 7i n -i, and therefore 
eo is banned from the hierarchy. 

Conjecture 1 eo does not belong to the hierarchy. 

If this were proved, eo would actually be a good candidate for extending the hierarchy above 
the TL n . Indeed, a current field of research is to capture as many structures with dccidable monadic 
theory as possible. A way to do so would be to find an operation extending those used in this 
paper — interpretation and treegraph. 

One can find definitions [16] of a canonical fundamental sequence for ordinals greater than eo 
and therefore define covering graphs outside of the hierarchy. For instance, one can take £o[n] = 
to i\(n + 1). In this way, covering graphs may be defined for a large number of ordinals; but we 
conjecture that the Theorem [7] does not stand any more, i.e. for any definition of fundamental 
sequence, there are two ordinals whose covering graphs have the same monadic theories. 

Also, the ability to differentiate covering graphs smaller than eo leads to check this robustness 
for more difficult questions. One of them is selection in monadic theory, which is negative for 
ordinals greater than w" [12] . 

In another direction, it would be interesting to remove the well-ordering property and to 
consider more general linear orderings. The orders of Q and Z are obviously prefix-recognizable. 
We would like to reach structures of more complex orders. 
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A Proofs 

A.l Proof of Lemma Q] 

Lemma 1 The transitive closure of H is < . 

Proof. Let < \i < X 2 be two ordinals. We prove that Ai -< k A2 for some finite k by induction 
on A2. If A2 is successor, consider X' 2 such that A 2 + 1 = A 2 , so A 2 -< X 2 . Otherwise, since the 
fundamental sequence of A2 bounds all smaller ordinals, there is a smallest n such that Ai < 
X 2 [n] -< A2, so let A 2 = A2[n]. In both cases, by induction Ai -< fe A 2 and thus Ai -< k +1 A2. □ 

A. 2 Proof of Lemma [2] 

Lemma 2 If a± < X± < a 2 , ct\ -< 012 and Ai -< A2, then A2 < a 2 . 

Proof. We proceed by induction onai = (3 + uj 1 , 7 < ot\. Note that a 2 > a.\ + 1. According to the 
definition of -<, there are two cases left. We suppose Ai + 1 < A2, otherwise the lemma is trivially 
true. 

Let (3 denote the RCNF of In the first case, a 2 = /3W+ 1 . Then, in RCNF, Ai = (3+uj~< .ci+Si 
and Si < uf 1 . Now if Si = 0, then ci > 1 and A2 = (3 + uj 1+1 = a 2 . If Si ^ 0, note that the only 
part that changes between an ordinal and a member of its fundamental sequence is the last term 
in RCNF. So A2 is written (3 + up .c 2 + S 2 in RCNF with S 2 < oj 1 , and therefore A2 < o;2- 

In the second case, a 2 = j3 + uj 1 with 7 -< 7', 7 + 1 < 7'. In RCNF, Ai = j3 + ui^ 1 .ci + Si with 
7 < Mi < 7' an< i a ^ least one of the following is true : 61 ^ 0, or 7 < Hi, or c\ > 1. Again, we have 
to deal with several cases. 

Either Si = and 7 = //]_; then ci > and A2 = f3 + cj 7+1 < a 2 . 

Or Si = and 7 < fj,i] then \ 2 = (3 + u>^ 2 and [i-i < fi 2 ; this is where the induction property is 
applied to get fj, 2 < 7', so A2 < a 2 . 

Finally, if Si ^ 0, as before A 2 = /3 + w' 11 .c 2 + 5 2 < (3 + w 7+1 < a 2 . □ 

A. 3 Proof of Lemma [3] 

Lemma 3 For any uj^[(n — l)<a<ui^[n and n > 0, the out-degree of Q a is n. 

Proof. We take the cardinal of {/1 1 A -< /i < uj ffn} for an upper bound of the output degree of 
A < a in Q a . If n = 0, A = and 1 = w -f[-0, so the set is empty. For n > 0, let A ~ (3 + up and 
A -< //, then either /i = A + lor/i = /3 + tJ 7 with 7 -< 7'. Since 7' < to f|~(n, — 1), by induction 
\W I 7 -< 7' < w - !)}| < ^ - 1, which leads to |{^ | A -< fj. < uj ffn}| < n. 

For the lower bound, if n = 1, then a G [2,w], and 0^1 has degree 1. For n > 1, if 
a > u) -ff (n — 1) then 

uj -ft- (n - 2) -< uj -ft- (n - 2) + 1 

w a>t(n-3)+l 

-< w- 

-< W" 

-< a; -fl- (n - 1) 

so uj il (n — 2) has degree n m Q a . □ 



A. 4 Proof of Lemma [4] 



Lemma 4 For any a < u> ft n, if a is successor then u(pi) is a finite word of [0,n]*; otherwise 
u(a) is an ultimately periodic word of [l,n] w . 



Proof. Lemma [3] ensures that the degree word is a word on the alphabet [1, n]. Since the transitive 
closure of Q a is isomorphic to a, the greatest sequence a of Q a is unbounded, i.e. VA < a, 3n(a„ > 
A). In particular, if a = A + 1, there is n such that er„ = A, and the sequence is finite. The last 
element has out-degree 0. 

If a is a limit ordinal, each a[n] must be in a. Indeed, let m be such that o~ m < a[n] < a m+ i; 
if the inequalities are strict, since a[n] -< a, by Lemma cr m +i > a which is a contradiction. So 
one of o~ m or cr m +i must be a[n]. 

We want now to prove that the pattern between the (a[n]) n < w is always the same. Let a = 
/3 + lu 7 . As before, we have two cases. If 7 = 7' + 1, then a[n] = (3 + uf 1 .(n + 1). Given n, there is 
a path in the greatest sequence 

a[n] -< a[n] +<$!-<•■•-< a[n) + 5^ -< a[n + 1] 

with 5{ < uf 1 for each i, and in fact <5j_|_i is the greatest such that Si -< 8i+\ and 8i+\ < lo 1 . This 
defines the (Si) sequence independently of n. If i is fixed a n varies, a[n] + Si -< a[n] + x whenever 
Si < x and x < w 7 , so the degree is still the same. The degree word is therefore ultimately periodic. 

In the second case, a[n] = f3 + ui 1 ^ and y[n] + 1 < j[n + 1] < 7. So (3 + uj 1 ^ n ' +1 is in Vg a . 
Since a[n] -< (3 + uj' 1 ^ +1 , then the following element of a[n] in the greatest sequence is greater 
than (3 + wtM+I anc j j s therefore of the form [3 + uj{ with y[n] -< Sx. In general 



,7[«] 



< (3 + u Sl ~< < (3 + uj &h < a[n + 1] 



s h 



are in the greatest sequence. Then j[n], Si, ... , j[n + 1] arc in the greatest sequence of 7 and their 
output degrees are respectively the same than those of uj^ n \uj Sl , . . . , cj 7 [™ +1 1 in a, minus 1. By 
induction, if the sequence of 7 is ultimately periodic, so is the sequence of a. □ 



A. 5 Formulas of Lemma [6] 



r(p, q) := p -< q A Vr (p -< r =>■ r -<* (7) 

dfc(p) := 3gi, . . . , % L^P^ftA?,^ q,- 

root(X,p) := V<? £ X, VF C X (p G F A closcd(r) ^ 9 gF) 

closed(F) := Vx, y G V ((.x 6lAi — ► y) j/ G X) 

size k (X) :=3q 1 ,...,q k \ f\ q t ^ q 3 ; A Vq G X ( \f q = q t ) 

inlfne(X) := 3r e I (root(X, r) A Vp G X 

\p = r V 3!<? 6l(^p))A 3!g £l(p^ <?)]) 



In the if u formula, the {pi)i<\ u \ form the static part, and the (qi)i<\ v \ the beginning of the 
periodic part V. The last lines describe the periodicity of the degrees in V with period \v\. 

Lp u := 3pi, . . . ,p\ u \,V,qi, . . .,q lv \ G V : 

\u\-l 



root 



(pi)A f\ r(pi,p i+1 ) Ad Ui (pi) \ Ar(p| u |,gi) Ai9 U|u| (p| u |) 



/H-i \ 
Aroot(V, qi) A f\ r(&, q i+l ) A d Vi {q^) \ A d V]v] {q\ v \) 

Ainline(V) A Vg G V, 3X C V, g' G X : 

mlme(X) A size| t ,| +1 (X) A root(X, q) A end(X, q') 

A I A d k {q)^d k {q') 
\k<n 



A. 6 Proof of Lemma [9] 
Lemma 9 Q u a = I o Treegraph(C? Q ). 

Proof. As stated in Section [TJ w Q is isomorphic to the set of decreasing sequences of ordinals 
smaller than a in lexicographic order. Let T = Treegraph(£J Q ); the of the root graph is still the 
only root, we call it r. Each p G Vr marked by M can be mapped into a decreasing sequence. If 

r ~* ^ > then there is a finite sequence [pi)i<k such that r - ^> po, pi - ^> Pi+i for i < fc 
and j»fe = p. Each pi is a copy of some ji < a with 7i+i < 7i, so the mapping p i— » (79, . . . , j k ) is 
bijective from marked vertices of T to decreasing sequences of a. 

The interpretation tp provides the relation to make this bijection an isomorphism. Let G = 
(p o Trccgraph((? Q ). We distinguish the three cases of the definition of -<. 

-Up ► q, then q is mapped to (70, . . . , 7&, 0). This is the successor case [3 P + 1 — f3 q . 

— If p > <j, then let I be the smallest integer such that 7/ = ji+i = • • • = 7fc- Then q is 

mapped to (70, . . . , 7/-1, 7/ + 1). This corresponds to the case (3 P = /3 + cj 7! .(k — l)-< /3 + cj 7!+1 . 

— If p </, then q 1— > (70, . . . ,7fc-i, 7) with 7^ -< 7. The marking M ensures that q is mapped 
to a decreasing sequence. This is the recursive case, where /3 P = /3 + uj lk , [3 p = j3 + w 7fe and 
Ik < Ik- 

□ 



A. 7 Proof of Lemma 

Lemma 13 For n > 0, there is a monadic formula describing exp(u;, n, k) + C\ in the covering 
graph of an ordinal greater than exp(u;, n, k).2. 

For any ordinal a, we define a sequence S a . We note r(a) the greatest 7 such that a -< 7. 

— a G iSa , a + 1 G S a , 

— if A G S'q, and a < A -< 7, then 7 G unless 3A' < A such that and A' G S a and A' -< t(j). 
It is easy to express S'q with a monadic formula. It happens to be the requested set. 

Lemma 18 The set <Sexp(w,n,fc) * s exp(w, n, k) + m the covering graph of an ordinal greater 
than exp(w, n, k).2. 



Proof. Let a = exp(w,n,fc). First of all, r(a.2) = w <«p(w,n-i,k)+i an d a -« w exp( w ,*-i,*)+i so 
r(a.2) ^ S* Q . By Lemma [3J any path from a to an ordinal of [a.2, w exp ^ ,n_1,fe ' +1 [ goes through 
a.2, and paths to ordinals of [cj ex P( w > n ~ 1 ' fe )+ 1 , exp(cj, n, k + 1)[ go through a successor of a which 
is not in S a , so S a f~l [a.2, exp(w, n,k + 1)] = 



Let A E [a, cc.2[, A = /3 + cj 7 .c + 77 in RCNF with c> 1 (as in Lemma El we use the notation (3 
to note the RCNF of (3) . By Lemma [2] again, any path from a to a + A goes through 



A' = $ + w~t 



and A" 



a 




7+1 



a.2 



But then A' -< /3 



,7+ 



1 = t(A") when c> 1, so A" ^ S a . 



Recursively, we suppose that any path from exp(w, n — 1, k) to 7 with exp(w, n — 1, fc) < 7 < 
exp(w, n — 1, fc).2 goes through 7' and 7", with 7' -< t(t // ). Then if A = /3 + + 77, define 

A' = /3 + cj 7 ' 
and A" = /3 + w 7 " 

which propagate the property to level n. All this proves that if A = a + uj 1() + ■ ■ ■ + uj lj in CNF. 
then all 7$ are distinct and are in C^_ t . Therefore S a Ca + Cj. 

For the other side, let A E a + C%. If A = a the case is done, otherwise 

A = a + uj 1 " + • • • + uj~ th 



with each 7$ € 

We have to prove that 3A' -< A in C*. By induction, for 7^ > 0, EI7' -< 7 in C^_ t , so A' = 
answers to the question (since the 7, are decreasing, the "distinct" constraint 



,70 



■ 10 ' 



,70 



is respected). If 7^ = 0, then we take A' = a ■ 

Now r(A) = a + w 70 + Vuj T ^ h \ If A' 6 S a is such that A' -< r(A), then A' = a + w 70 + h 

(j7fc-i _|_ w 7 f or gome 7 £ 7d fl Cn-i) but then by induction we never have 7 -< r(7ft), which is a 
contradiction. 



A. 8 Proof of Proposition [TYl 

Proposition 17 TTie graph of uj ^ n is isomorphic to the prefix-recognizable graph of order n with 
support S{dom(u) f|- n)) and one relation R(inc(to f|~ n)). 

Proof. The theorem is easy for n = 1. Vertices of ui are precisely all 1-stacks; i?(inc(w)) is the 
successor relation, while i?(dec(w)) is the symmetric relation. 

We suppose now that n > 1, and that there exist dom(a), inc(a), dec(a) operations in Reg(Ops n -\) 
such that (S , (dom(a)), R(dec(a)), i?(inc(a))) is isomorphic to (a, >,<}. We also suppose that 
dec(a)(5(dom(a))) C 5(dom(a)). For any 7 < a, we note s 7 the corresponding (n — l)-stack. 

Note that if k < n, all operations on fc-stacks are valid on n-stacks. So if / E Reg(Opsk) is 
and operation and s, s' are two fc-stacks such that (s, s') E , and if p,p' are the same n-stack 

except for the top-most fc-stack which is respectively s and s' , then (p,p') E R(f). 

Let S 1 = dom(u! a ) and let p 6 5 be a non-empty finite sequence of (n — l)-stacks, so p = 
[s 7o , . . . , s 7 J. In the definition of dom(w a ), there is no pop n operation, and by the induction 
property and the above remark, s 7o , . . . , s 7fc are all in S'(dom(a)). By hypothesis on dec(a), we 
also have s 7o > •■ • > s 7fc ). As a consequence, the mapping 

P = [s-yo, s 7 J >-> A = uj 10 + h LU lk 



is well defined and is injective. In fact, it is a bijection between S and [l,u> a [; omitting is not a 
problem for infinite ordinals. We therefore note p\ the n-stack associated to A. 

Now if let < A < A' < a be two ordinals, with A = w 70 H h lu 1 " in CNF. Then 

either A' = lo 10 H h u> lk H h u^ 1 with k < k' , 

or A' = oj 10 + ■ ■ ■ + + ■ ■ ■ + oj 7i + 1 + ■ • ■ + uj~' k ' for some i < k, 

with 7 i+1 < 7j' +1 . For the first case, the use of tail(a) on p\ has already been discussed, so 
{p\,P\>) € i?(tail(a) + ). In the second case, popl fc 1 1 (j>\) — [s 7o , ■ ■ • , s 7i+1 ] and, by induction, 

([s 70 ,...,s 7i+1 ],[s 70 ,...,s 7 - + J) e fl(inc(a)). 

Again, the tail operation is used. The converse — if (p\,py) E S 2 (~l i?(inc(w Q )) then A < A' — is 
straightforward. So (S*, i?(inc(w Q ))} is indeed isomorphic to (a, <}. 

The dec operation is similar. In the first case, pop^ k \p\>) = p\ with k' — k > 1. In the 
second case, pop^ fe = [s 7o , . . . , 1 ] and 

([s 70 , . . . , s y > +i ], [s 70 , . . . , s 7i+1 ]) e i?(dec(a)). 

The converse is direct as well, and proves in the same time the last needed induction property : 
dec(oj a )(S) C S. Note that this was not true with inc : inc(o; Q )(S') % S, because we could lose the 
decreasing constraint of the CNF. 

Finally (S, R(\nc(uj a ), R(dec(oj a ))} is isomorphic to (a, <, >} and the induction properties are 
fulfilled. □ 



